THE ODD LITTLEWOOD-RICHARDSON RULE 



ALEXANDER P. ELLIS 



Abstract. In previous work with Mikhail Khovanov and Aaron Lauda we introduced two 
odd analogues of the Schur functions: one via the combinatorics of Young tableaux (odd 
Kostka numbers) and one via the odd symmetrization operator. In this paper we introduce a 
third analogue, the plactic Schur functions. We show they coincide with both previously de- 
fined types of Schur function, confirming a conjecture. Using the plactic definition, we estab- 
lish an odd Littlewood-Richardson rule. We also re-cast this rule in the language of polytopes, 
via the Knutson-Tao hive model. 
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1. Introduction 

1.1. The classical story. Schur functions play a central role in the beautiful circle of ideas 
around symmetric functions, symmetric and general linear group representations, and linear 
enumerative geometry. On the one hand, the Schur functions sx corresponding to partitions 
X of k give an integral orthonormal basis of the algebra of symmetric functions A in degree 
k. Under the Frobenius correspondence (see, for instance, IISta99l Section 7.18]) 

0Ko(C[5„])-A, 

n>0 

the Schur function s\ corresponds to the irreducible representation Lx associated to the par- 
tition A. Recall that the product on the symmetric group side is given as follows. If F is a 
representation of Sk and is a representation of Se, then 

(1.1) m-[w^] = [ind|+4(y^TF)]. 

On the other hand, the ring A„ obtained by setting S(in+i) = S(in+2) = . . . = can be viewed 
as the character ring for polynomial representations of GL„(C). Under this correspondence, 
the image of sx in A„ equals the character of the irreducible representation Vx associated to 
A. This time the product is the usual product of characters, that is, s^s^ is the character of 
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Vfj^iSiV^. Either of these two descriptions immediately implies that the structure coefficients 
of a product 

(1-2) Sf,Su = ^c^,ySx 

X 

are all non-negative integers; they are called Littleiuood-Richardson coefficients. The deter- 
mination of these coefficients is a classical and important problem. By the above, c^j, has 
interpretations as 

(1) the multiplicity of La in Ind^^^'<.^(L^ L^), 

(2) the multiplicity of VxinVf^(S> Vy, and 

(3) the dimension of the space of GL„(C)-invariant vectors in V^^V^^ V^. 

The combinatorics of Young tableaux become an important tool at this point: partitions cor- 
respond to Young diagrams, and the coefficients c^^ can be computed by counting certain 
skew tableaux. We review this Littlewood-Richardson rule in Section |4.1t more complete 
expositions can be found in |Ful97l Chapter 5] and [Sta99', Appendix Al]. 

Schur functions also arise in linear enumerative geometry. The cohomology ring of the 
Grassmannian Gr(A;, n) of complex fc-planes in is isomorphic to the quotient of by 
the ideal generated by all complete symmetric functions /i^ for m > n — k. Geometrically, 
elementary functions Cm correspond to the Chern classes of the tautological A;-plane bundle 
and complete functions hm correspond (up to sign) to the Chern classes of a complemen- 
tary (n — fc)-plane bundle. Under this identification, the image of the Schur function sx in 
H* {Gv{k,n)) equals zero unless Ai < n — k and ^(A) < k. The nonzero Schur functions give a 
basis of the cohomology ring, and sx is Poincare dual to the class of a corresponding Schubert 
variety. Relative to a fixed full flag = Vq C Vi ■ ■ ■ C Vn = C", a point W G Gr(A;, n) is in the 
Schubert variety Cx for the partition A if and only if 

dim{W nVi)>i + Xi-{n-k) 

for 1 < i < n. By (|1.2|) , then, c^,^ is the coefficient of [Cx] in the cup product [C^] • [C,y]. 
Therefore we have a geometric interpretation of c^j, as 

(4) the multiplicity of [C\] in the cup product [C^] • [C^]. 

When + |z^| = dim(Gr(/c, n)) = k{n — k), the coefficient c^" is the (finite!) number of 
A;-planes satisfying the dimension criteria of both and Cp. For example, one can use this 
analysis to compute the number of lines which intersect five general 3-planes in = P(C^). 

All of the above is to say that Schur functions provide important insight into areas of 
geometry, algebra, and representation theory. The goal of this paper is to provide a small 
first step in this direction in the odd setting, in a sense we will now describe. 

1.2. Outline of this paper. An ongoing project initiated in joint work with Khovanov and 
Lauda is an attempt to give a construction of the Ozsvath-Rasmussen-Szabo odd Khovanov 
homology [ORS07J via a 2-representation-theoretic approach analogous to Webster's con- 
struction of (even) Khovanov homology [WeblOa], [WeblOb]. As a byproduct of this inves- 
tigation, an "odd" analogue OA of the algebra A was defined and found to admit signed 
analogues of many of the combinatorial properties of A IIEKllL IIEKLllL We gave two dif- 
ferent candidates for elements playing the role analogous to that of Schur functions. The 
present work gives a third candidate, proves all three definitions are equivalent, and proves 
an odd analogue of the Littlewood-Richardson rule. 
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Section IZTl reviews the definitions and basic properties of odd symmetric functions and 
odd Schur functions; the short Section IT21 gives a convenient notation for the many signs 
which arise in the odd setting. Section lSAl contains the new definition of odd Schur functions, 
and Section l3!2l proves the following. 

Theorem. The three definitions of odd Schur functions all coincide. 

In Section |4T] we review the even Little wood-Richardson rule, and in Section l42l we formu- 
late and prove an odd analogue. 

Theorem. The odd Littlewood-Richardson coefficient c^^ is a signed count of semistandard 
skew tableaux S of shape A//x and content u such that the row word of S is Yamanouchi. 



Finally, in Section l43l we re-cast the odd Littlewood-Richardson rule in the language of 
Knutson-Tao hives. 

1.3. Acknowledgments. The author thanks Mikhail Khovanov for many helpful conversa- 
tions and suggestions. For the duration of this work, the author was supported by an NSF 
Graduate Research Fellowship. 

2. Review of odd symmetric functions 

2.1. Odd symmetric polynomials. Now we will briefly review the constructions of |EK11| . 
HEKLIII . Let n > 1 and let 

OPoln = Z(xi, . . . ,Xn)/{XiXj + XjXi if i / j) 

be the ring of skew polynomials in n variables. The ascend-sorting of a monomial Xi^ ■ ■ ■ Xi^ 
in OPol„ is defined to be the monomial obtained by sorting the subscripts ii, . . . ,ir into non- 
decreasing order without introducing any sign. For example, the ascend-sorting of X1X3X2 is 
X1X2X3. We will sometimes write : X : for the ascend-sorting of a monomial X. 

Although the generators xi,. . . ,Xn pairwise supercommute, the algebra OPol„ is not su- 
percommutative: 

(Xi + X2)xi = Xi{xi - X2). 

The algebra OPol„ is finite dimensional in each degree and has no zero divisors, but it does 
not have unique factorization: 

(Xl - X2)^ = x'l+xl = (xi + X2)^. 

Have the symmetric group Sn act on the free algebra . . . , Xn) as 

-Xi+i iij = i, 
-Xi ifj = i + l, 
-Xj ifj^i,i + l, 



(2.1) Si{xj) 



where Sj is the transposition of i and i + 1 and the action of Sj is a ring endomorphism. For 
i = 1, . . . , n — 1, the i-th odd divided difference operator is the Z-linear map di : Z(xi, . . . , x„) 
. . . defined by 



(2.2) ^'^^^^ lo otherwise. 



1 ifj = i,z + l, 
otherwise, 

mg) = d,{f)g + s,UWg). 
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The second line is called the Leibniz rule. It is easy to check that 

di{xjXk + XkXj) = 

for all j, k, so we can consider di as an operator on OPol„. On OPol„, the kernel and image 
of di coincide; by contrast with the even case, however, these do not equal the space of 
invariants or anti-invariants of the action of Sj. 

Definition 2.1. The ring of odd symmetric polynomials is the subring 

n-l 

(2.3) OA, = fl keiidi) C OPol„. 

i=l 

We endow 0A„ with a Z- and a Z/2-grading, whose degree functions we denote by deg^ 
and degg respectively. Write deg(/) = {deg'^{f),degg{f)) for short. The degree of each Xi is 
defined to be 

deg(xi) = (2,1). 

We will consider 0A„ as a superalgebra via the Z/2-grading. In particular, the product 
structure on 0A„ (g) 0A„ is, on homogeneous elements. 

For i = 1, . . . , n, let = (— l)*~^Xj. We define elements of OPol„ for each k > I, 

l<ii<...<ifc<n 

hk — ^ ^ ^ii ' ' ' ■^ik' 

l<ii<. ..<i(,<n 

Set eo = = 1 and Sk = hk = for k < 0. If k > n, then = 0. Both these families of skew 
polynomials are odd symmetric, and they satisfy the relation 

e 

^(_l)|Mfc+i)e,/j,_, = o if^>l. 

fe=0 

They also satisfy the odd defining relations, 

eneh = ChCa if a + 6 is even, 

(2 4) 

eadb + {-'^Te.bea = {-Ifea+ieb-i + e^-iea+i if o + 6 if odd. 

The relations (|2.4|) also hold if all e's are replaced by h's. 
This next proposition follows from Section 2.1 of |EKL11[ . 

Proposition 2.2. The algebra OA has a presentation by generators eo = 1, ei, 62, . . . and re- 
lations \2A) . A basis for OA in Z-degree 2k is given by all products e\^ - ■ ■ with Ai > 
. . . \r > 1, \ + . . . + \\r \ = k. The same is true if all e's are replaced by h's. 

The products e\ = ■ ■ ■ and h\ = ■ ■ ■ h\^ with Ai > . . . > Ar are called odd 
elementary symmetric functions and odd complete symmetric functions, respectively. The sets of 
elementary and complete functions in Z-degree 2k are naturally indexed by all partitions of 
k. 
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There are maps 

OPol„+i ^ OPol„ 
Xj Xj if 1 < i < n, 
x„+i H- 0. 

These induce maps OA„+i 0A„ which send hk i-> hk and i-> 6^ for all k. The inverse 
limit in the category of graded rings of the resulting system is called the ring of odd symmetric 
functions, 

OA = 1^0 A„. 

The ring OA can be given the structure of a Hopf superalgebra |EK1H . The coproduct is 



i+j=k i+j=k 



As a Hopf superalgebra, OA is neither commutative nor cocommutative. 
As a result of Proposition l2.2l we can define certain symmetries of OA, 

bialgebra automorphism (not an involution), 

algebra involution (not a coalgebra homomorphism), 

algebra anti-involution (not a coalgebra homomorphism). 

The map is an involution, and both V'l, ^2 commute with ^^3. The antipode of the Hopf 
superalgebra structure on OA is 5 = V'iV'2V'3- For a partition A = (Ai, . . . , A^), define 

e, = (-l)E.|Aj(Aj-i)^ 

where A^ is the transpose (or dual, or conjugate) partition to A. That is, Aj is the height of 
the j-th column of A. The involution V'iV'2 exchanges the elementary and complete bases up 
to sign. 



(2.5) ^iM^x) = {-Ipe^Thx, i^iMhx) = (-l)'^' 



In I|EK11I , an odd analogue of the Schur functions was given as follows. From here on, we 
will identify partitions and Young diagrams without comment. Recall that a Young tableau T 
on a partition A with entries in an ordered alphabet A is an assignment of an element of A to 
each box of A. When considering OA we will take A = Z>o and when considering 0A„ we 
will take A = {1, . . . ,n}. A tableau T is called semistandard if its entries are non-decreasing 
in rows (left to right) and strictly increasing in columns (top to bottom). The row word Wr{T) 
of a tableau T is the word in the alphabet A obtained by reading the entries of T from left to 
right, bottom to top. For example. 



1 


1 


2 


2 


CO 





is a semistandard Young tableau of shape (3, 2), and Wr{T) = 23112. 
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The content of a tableau T is the tuple (oi, . . . , a^), where Oj is the number of entries of T 
equal to i. For each partition A, there is a unique Young tableau Tx of shape and content both 
equal to A. For example. 



^(21) 



1 


1 


2 







1 


1 


1 


^(311) - 


2 








3 







If T is a Young tableau, write sh(r) for its shape and ct(r) for its content. Let SSYT{X) be the 
set of semistandard Young tableaux of shape A and let SSYT{X, /x) be the set of semistandard 
Young tableaux of shape A and content fi. 

In order to use tableaux in the odd setting, define the sign of a tableau T, denoted sign(T), 
to be the sign of the minimal length permutation which sorts Wr{T) into non-decreasing 
order. For instance, with T as above, 

sign(r) = {-If = -1, sign(r(2i)) = {-If = 1, sign(r(3n)) = (-1)' = -1. 

For partitions A, /i, the odd Kostka number Kx^ is defined to be a signed count of semistandard 
tableaux of shape A and content //, 

(2.6) Kx^ = si^{Tx) ^iS'^(^)- 

T£SSYT{\,^l) 

It is readily verified that as a matrix, {Kxix)\\\=\^\=k is lower triangular and unimodular when 
the partitions basis is ordered lexicographically, so we can define the family of combinatorial 
{or Kostka) odd Schur functions by the change of basis relation 

(2.7) V = E^V^^' 

Ahfc 

where fi\- k. 

The following proposition combines several of the statements from Section 3.3 of (EK11|I . 

Proposition 2.3. The family {sf}x\-k is an integral unimodular basis for OA in Z-degree 2k. 
This family is signed-orthonormal, 

(2.8) {sts^) = exSx^, 

with respect to the bilinear form of |EK11| . The involution and the anti-involution V's 

act on sx as 

(2.9) i^iMs^) = Ms^) = 6Asign(r,)sf . 

Here, wx is the element of Sk which is combinatorially defined in Proposition 2.14 of |EK11II 
(it is the minimal representative of the unique double coset in SxT\Sk/Sx which gives a 
nonzero homomorphism from Ind|* (Vi:riv) to Ind^'=^ (V-sign)) and £ is the Coxeter length func- 
tion. 

In lEKLlll . another family of Schur functions was introduced. Let 

dtuo = di{d2di) ■ ■ ■ {dn-i ■ ■ ■ di), 

a particular choice of longest odd divided difference operator (odd divided difference oper- 
ators corresponding to other choices of reduced expression could differ by a factor of — 1). 
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For a skew polynomial /, let be the result of acting by wq on / via the action (|2.1|) . The 

odd-symmetrized Schur functions are defined by 

(2.10) si = i-lp) (9^„(x^ •••x^xri4-2...x„_i))"° . 

For the motivation behind this name, see Section 2.2 of IIEKL11| . The goal of Section |3^ is to 
prove that for all A, = s^. 

2.2. Boxterpretations. It will be convenient to have a systematic way to handle the signs 
which arise in the odd setting. Most combinatorial quantities arising in these signs can 
be described by counting certain boxes in some Young diagram or tableau; we call these 
descriptions "boxterpretations." Here are some which have already arisen: 

• For a Young diagram A, the sum ^Xj{Xj — 1) can be described as: for each box 
B, add the number of boxes directly above B. This is the exponent of —1 used in 
defining the sign ex- 

• For a Young diagram A, the quantity £{wx) can be described as: for each box B, add 
the number of boxes above and to the right of B. 

• For a Young tableau T: for each box B, add the number of boxes above and with 
smaller entry. Then sign(r) equals —1 raised to this count. 

• As a special case of the previous, to obtain sign(rA), for each box B, count the number 
of boxes above B. 

We will use notations adapted from |Ful97 l to help condense these descriptions. If a box B 
of a Young diagram is in a row above that of a box B', we say B is North of B'; if B is North 
of or in the same row as B', we say B is north of B'. Likewise for East/east, West/ west, 
and South/south. Write N{B) for the number of boxes North of B, sW{B) for the number 
of boxes southWest (both south and West) of B, and so forth. If we are considering a Young 
tableau and decorate a direction with one of {<,<,>,>}, this means to only count boxes 
with entry lower than (lower than or equal to, greater than, greater than or equal to) B. 
So (B) means the number of boxes East of B with strictly greater entry than B. If we 
evaluate one of these counting functions on a diagram or a tableau, we mean to sum over all 
boxes, evaluating the function at each. For instance, 

SW-{T)= ^ # {boxes of T Southwest of 5 with entry > that of S}. 

BeT 

One last decoration: dN means directly North, that is. North and neither East nor West (and 
likewise for the other counts). 

Example 2.4. Let 



T = 



1 


1 


2 


2 


2 


3 


3 


4 


3 


4 


4 




5 


6 







Then dN{T) = 16, E>{T) = 28, and sW{T) = 47. 

In this notation, we have the following boxterpretations: 

e^ = (_l)rfiV(A)^ = (_i)JVi?(A)^ sign(r) = (-l)^^(^), sign(rA) = (-1)^^. 
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3. Odd plactic Schur functions 



3.1. Definition and basic properties. Let A = {ai, 02, . . .} be an ordered alphabet. In prac- 
tice, we will take A = Z>o when working with OA and A = {1,2, . . . ,n} when working with 
0A„. In order to add, multiply, and assign signs to tableaux, we will use the odd plactic ring 
ZPl, which is the unital ring defined by 



(3.1) 



generators: 
relations: 



A 

yzx 
xzy 



-yxz 
-zxy 



if X < y < z 
if X < y < z 



When we want to emphasize that the alphabet in question is {1, 2, ... , n}, we will sometimes 
write ZPln instead of ZPl. The relations {K'), {K") are called elementary Knuth transformations. 
We define a map from the set of semistandard Young tableaux with entries in the alphabet 
A to the odd plactic ring by 



(3.2) 



{SSYTs} ^ ZPl, 

T ^ Wr{T). 



Since both the relations {K'), {K") are transpositions of letters with a minus sign, sits 
as an intermediate quotient between a free algebra and the skew polynomial ring, 

where the first map sends xi to i and the second map sends i to Xj. If it; is a word in 'LPln, 
we will write x"^ for the image of w in OPol„. In particular, a semistandard Young tableau T 
is sent to x"'''^^). 

The utility of the plactic ring is in large part due to the following remarkable theorem. 



Theorem 3.1 ( IIFul97L Section 2.1). Every word is equivalent, via relations {K') and {K"), to 
the row word Wj- (T) of a unique tableau T. 

Thus the set of all Young tableaux with entries in A forms a basis of ZP/. We will informally 
refer to the multiplication of tableaux in the following; what we mean is the multiplication of 
their row words in ZP/. In terms of tableaux, the relations {K') and {K") can be interpreted 
as "bumping transformations": 



{K') 
[K") 



y\z \ • |_x 





x 


z 




y 






X 


y 




z 





if X < y < z, 
if X < y < z. 



For a detailed exposition of bumping, see Section 1.1 of |Ful97| . 

If a word w is known to be the row word of some tableau, then it is easy to reconstruct 
the tableau from the word. Since the row entries of a tableau never decrease from left to 
right and the column entries must always increase from top to bottom, reading the word w 
from left to right until the first adjacent decreasing pair simply gives the bottom row of the 
tableau. Then continuing to read until the next adjacent decreasing pair gives the second to 
bottom row, and so forth. 
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Example 3.2. Using Z>o as the ordered alphabet, 

w = 53422331112 corresponds to 



1 


1 


1 


2 


2 


2 


3 


3 


3 


4 






5 









Definition 3.3. Let A be a partition. Define an element of ZP/„ by 

(3.3) = (_l)rf^(A)+7V(A) ^ J. 

T&SSYT{X) 

Its image in OPoln, 



(3.4) ,P = (_i)<iiV(A)+^(A) ^ 



^ f_^-^dN{X)+N{\) ~Wr{T) 
T£SSYT{\) 

is called the plactic odd Schur function corresponding to A. 



The label p in the notation for the plactic odd Schur function is to distinguish it from the 
combinatorial odd Schur functions of [EKllll and the odd-symmetrized Schur functions 

of |EKL11| : once we prove these three objects are equal later in this section, we will drop 
the extra labels. 

Remark 3.4. For the rest of the paper, we will not always specify whether we are working 
in OA or in 0A„. Generally speaking, results will hold in OA. The only change required in 
passing to 0A„ is the understanding that certain elements become zero. It is easy to see that 
0A„ = OA/ {cm '■ fn > n), and it will follow from Theorem 13.81 that sa = in 0A„ if and only 
if A has height greater than n. With this understood, the proofs and results in the rest of this 
paper work in either context. 

Lemma 3.5. If A = (l*'), then up to sign, all three Schur functions coincide with the corre- 
sponding elementary polynomial: 

(3.5) sj^.) = s^,^ = s^,^ = (-l)l'=(^-i)efc. 

If A = {k), the combinatorial and plactic Schur functions coincide with the corresponding 
complete polynomial: 

(3.6) sjl) = sj"^) = hk. 

The last equation equals s^^^ too, but we will prove this later. 

Proof. The equality sj^^^ = et follows from Proposition 3.10 of KEKTTII and the 

equality s^^;,^ = Ck is Lemma 2.25 of llEKLllL Since the row word of a semis- 

tandard Young tableau on the shape (1*^) isik - ■ -h for positive integers ii < . . . < ik and it 
takes \k{k — 1) transpositions to ascend-sort the monomial Xi^, ■ ■ ■ Xi^, the equality with s^^^j.^ 

holds. It is similar but easier to show s^^^ = hk, and = hk is obvious because the only 
semistandard Young tableau of content {k) is a row of I's. □ 
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3.2. Comparison with previous definitions. For a partition A, let j be the Young diagram 
obtained by removing rows 1 through i from the diagram corresponding to A. Similarly, 
let J, i\X, and A|i be obtained by removing rows i through the bottom, columns 1 through 
i, and columns i through the rightmost respectively. We say that a skew shape is a vertical 
strip (respectively horizontal strip) if no two of its boxes are in the same row (respectively 
column). We say that a diagram /i is obtained from A by adding a vertical strip if A C /x and 
/x/A is a vertical strip; likewise for horizontal strips. The following proposition was proved 
in HEKLIII . 

Proposition 3.6 (Odd Fieri rule, e-right odd-symmetrized version). Let A be a partition. Then 

The sum is over all /i obtained from A by adding a vertical strip of size k, and ii, . . . ,ik are 
the rows of A to which a box was added. 

The plactic odd Schur functions satisfy the same relation. We prove the horizontal strip 
variant instead, for simplicity. 

Proposition 3.7 (Odd Fieri rule, /i-right plactic version). Let A be a partition. Then 
(3.8) (-l)^^^^^^;,) = ^(_i)A'S(M)(_i)ln|A|+...+K.|A|^P^ 

The sum is over all /x obtained from A by adding a horizontal strip of size k, and ii, . . . ,ik 
are the columns of A to which a box was added. 

Proof. Expanding all Schur functions as odd plactic sums, we want to prove 

^_^-^dN{X)+N{X)+NE{X)~Wr{T)~Wr{V) ^ ^_^-^dN{t,)+N{f,)+NE{t,) ^_-^^^^\h\X\+...+\ik\X\~Wr{U) 

whenever T is a Young tableau of shape A, F is a Young tableau of shape (k), TV = U 
in the even plactic ring with sh(C/) = fi, and the boxes of fi/X are in columns ii, . . . 
This is because mod 2 the even and odd plactic rings are isomorphic (by the obvious map, 
Wr{T) Wr{T)), SO the set of products x'^riT)~wriV) ^^le set of terms x'^^i'^^ which occur 
on the right-hand side of (|3.8|l are in bijection, with (T, V) corresponding to U if and only if 
TV = U in the even plactic ring. Suppose the leftmost box of V has entry j. If that box ends 
up in column i, we claim 

^_^yN{X)+N{X)+NEiX)~Wr{T)~, ^ (^_^^^dNi,i)+N{,i)+NE{,i)+\i\X\~Wr{U) _ 

For any partition u, [-i)<iN{u)+N{u)+NE{u) ^ ^_i^nw{u)_ j^ie new box of ^ is not NorthWest 
of any other box (since it must be a southeast corner), so the sign discrepancy only counts 
those boxes NorthWest of the new box. The sign (— 1)NA| counts boxes NorthEast of the new 
box, so the overall sign is (— 1)^j^'^^^^^. And this is precisely the sign between x^^^^^Xj and 
since bumping a box past a row of length r incurs a sign of (—1)^"^. Finally, note that 
as the boxes of V are added one at a time, the signs cancel telescopically so as to yield the 
sign of equation (|3.8|l . □ 



We now have the tools necessary to prove the main result of this section. 
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Theorem 3.8. The three notions of odd Schur function all coincide: for any partition A, 
(3.9) = = si. 

Proof. The proof that = is similar in spirit to the proof of the odd Fieri rule, /i-right 
plactic version. By the same sort of analysis as in that proof, one shows that for a partition 



NE{T)+NE<{T)+dN{T)+N{T)~Wr{T) 



ct{T)=ti 

= ^_l^NE(X)+NE<iT}^P^^ 
A TeSSYT{X,fj.) 

Since /i^ = ^Xfi^x ^rid both {/i^}, {s{^} are integral bases of the ring of odd symmetric 
functions, it suffices to check 

(^_l^NEiX)+NE<iT) ^ (^_]_)Af(A)+7V<(T) 

whenever T is a Young tableau of shape A (the right-hand side is the sign with which T is 
counted in defining Kx^; see Section |2T|) . The sum computing the sign from a particular 
box BofT involves two types of other box: those Northwest and those NorthEast of B. For 
those NorthEast, the sign is identical. Those Northwest are ignored by the left-hand sign, 
but the entry of such a box is necessarily less than that of B (since T is semistandard), so the 
right-hand sign is +1. Hence = s^. 

We now use the Fieri rules (Fropositions 13.61 13. 7|) to prove = s^. For A = (l'^), this is 
true by Lemma |331 Using this as a base case, we now induct on the width of A, and within 
each particular width we induct with respect to the lexicographic order of A^. Since we have 
shown = s^, we can apply the involution ?/'i'i/'2 to equation i3.8^ to show the plactic Schur 
functions obey an e-right Fieri rule of the same form and signs as the one obeyed by the 
Schur functions s^, 



(3.10) 5^^,,) = j;(-i)i^r--i^Up. 

Let A be a partition of width Ai = r. Using the e-right Fieri rule, both types of Schur function 
satisfy 



5(Af)---^(A^) =5^±^/^> 



where each /i has width at most r and is lexicographically greater than or equal to A. The 
coefficient of sx on the right-hand side is ±1. All the signs ± are the same for the two types 
of Schur function, so this allows us to solve for both , in terms of elementary functions 
by the same expressions; hence = s^. □ 

Corollary 3.9. The span of the 'sx in is a subalgebra isomorphic to 0A„, and this subal- 
gebra is taken isomorphically onto 0A„ c OPol„ by the map w ^x^. 



For the rest of this paper, we will drop the superscript labels on odd Schur functions. 
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4. LiTTLEWOOD-RlCHARDSON RULES 

4.1. The even Little wood-Richardson rule. 

For this section only, we work in the even setting. 
Let ^, I/, A be partitions. The Littlewood-Richardson coefficient c^^ is the coefficient of sx in 8^8,^, 

A 

If|/i| + |z^| 7^ |A|, then c^^^ = 0. Schur functions are generating functions for semistandard 
Young tableaux of a given shape, 

T(^SSYT{X) 

It follows that, for any fixed semistandard Young tableau Tq of shape A, 

(4.1) cl, = #{U € SSYT{fi),V G SSYT{iy) : UV = To}. 

Here, the product of tableaux is taken in the (even) plactic ring. If Tq = Tx, then it is not hard 
to see that UV = Tx forces V to be T,y} equation (|4.H) becomes 

(4.2) c^, = #{[/ e SSYTifx) : UT, = Tx}. 

Since computing the set on the right-hand side of (|4.2|) can be tricky in practice, we would 
like to have a simpler combinatorial description of the c^^. The Littlewood-Richardson rule 
provides one of many such simpler descriptions. Good accounts of the rule and its proof are 
given m llFul97t Chapter 5] and I.Sta99. Appendix Al]. We will review the terminology and 
statement here. 

Recall that a (Young) skew shape A//i is the complement of a subdiagram fi C X. A semi- 
standard skew tableau is a skew shape which has been filled with entries from some ordered 
alphabet, subject to the same rules as for a semistandard tableau: entries must strictly in- 
crease in columns (top to bottom) and must not decrease in rows (left to right). We write 
SSYT{X/i.i) for the set of semistandard skew tableaux of shape A//.i and SSYT{X/ fi, v) for 
the set of semistandard skew tableaux of shape X/ ji and content u. 

A word w = wi ■ ■ ■ Wr 'vc\ some ordered alphabet is called Yamanouchi (or a reverse lattice 
word) if, when read backwards, each initial subword has at least as many a's as h's whenever 
a < b. For example, 312211 is Yamanouchi but 1221 and 112 are not. A skew tableau S 
is called a Littlewood-Richardson tableau if Wr{S) is a Yamanouchi word. The following is 
Proposition 3, Chapter 5 of IIFul97ll and Theorem Al.3.3 of LSta99J. 

Theorem 4.1 ((Even) Littlewood-Richardson Rule). The coefficient c^^ equals the number of 
Littlewood-Richardson tableaux S of shape A//i and content u. 

One specific bijection between the set described in the theorem and the set in equation 
(|4.2|) is described in the following section, where we use it to deduce an odd analogue of 
Theorem 14.11 

Example 4.2. Let /i C A be a subdiagram and let k = |A| — |//| > 1. If 5 is a Littlewood- 
Richardson tableau of shape X/fi and content (fc), then no two boxes of S can be in the same 



THE ODD LITTLEWOOD-RICHARDSON RULE 



13 



column (since all entries equal 1). And on any such skew shape X/fi, there is exactly one 
tableau of content (k). Thus c^^^-j = 
have deduced the (even) Fieri rule. 



tableau of content (k). Thus c^^^-j = 1 if A//x is a horizontal strip and equals otherwise. We 



(4.3) 



E 



A 

A//i is a 
horizontal strip 



Using the standard involution cj on A, or just arguing in analogy with the above, the same is 
true if {k) is replaced by (l'^) and "horizontal" is replaced by "vertical." 

Example 4.3. The lowest degree product which is not described by the Fieri rule is 

S21S2I = S22II + S222 + S3III + 2S321 + S33 + S411 + S42. 

4.2. The odd Littlewood-Richardson rule. The sign of a Young tableau T is the sign be- 
tween its row word monomial x'^^^'^^ and the ascend-sorting of that monomial. As explained 
in Section 12^11 this sign equals (— 1)^^(^). If 5 is a skew tableau of shape X/n, let j be an el- 
ement of the alphabet less than every entry of S and let S be the Young tableau of shape A 
formed by placing j in each box of fi and filling the rest so as to match S. We then define the 
sign of S to be 

sign(5) = sign(5) = iV<(^). 

When fj, = (0), this reduces to the sign of a tableau as defined earlier. More generally, when- 
ever we write a count E, nW-,dS, . . . evaluated on S, read S for S. 

Example 4.4. To either alphabet Z>o or {1,2,..., n}, we can always adjoin and take j = 0. 

If A = (3, 3, 2, 1), fj. = (2, 1, 1), and 







1 




1 


2 




2 




3 







then S 









1 





1 


2 





2 




3 







and sign(5) = (-1)^^ = 1. 



Remark 4.5. We consider the partition /i to be part of the data of 5. For example, both 
(1, 1)/(1) and (2) /(I) consist of a single box, but if we fill these two boxes with equal entries, 
the resulting skew tableaux have opposite signs. 

Definition 4.6. Let fi, u, A be partitions. The odd Littlewood-Richardson coefficient c^^, is the 
coefficient of when s^s,, is expanded in the basis of odd Schur functions. 



'flU 



sx- 



If 1^1 + \u\ / |A|, then c 



A 



0. 



Note that the odd Fieri rules compute certain odd Littlewood-Richardson coefficients. Us- 
ing the involution V'iV'2 and the anti-involution ip^, we know the odd Littlewood-Richardson 
coefficient c^^ whenever fior u has either height or width 1. 



If Y, Z are two nonzero monomials in OPoln such that Y 
the sign between them; for example sign(xiX22;3, X1X3X2) = 



±Z, then let sign(y, Z) denote 
-1. 
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Lemma 4.7. The odd Littlewood-Richardson coefficient c^j^ is 
(4.4) ^x^ ^ ^_-^^^dNi^^)+dNiu)+dN{x)+Ni^,)+T,,ix/uh\i^\ 

uessYT{^l) 

In the summation condition, the product UT^, is taken in the even plactic ring (so it is an 
equality up to sign in 



~Wr{U)~Wr{V) ^Wr{Tx)\ 



Proof. First note that 

C^^ = (^_iyNif,)+dN{u)+dNi\)+N{f,)+N{u)+N{\) ^ g-g^^j 

U£SSYT{fi) 
VeSSYT{u) 

(4.5) uv=T, 

= (^_iyNif,)+dNiu)+dN{\)+Nif,)+Niu)+Ni\) ^ sign(i"''-(^)j'""(^''\ J'^^^^^)). 

U£SSYT{fj.) 

The first equality is immediate from the definition of c^^ and equation (|3.4|l . The second 
follows from the following fact: if U, V are semistandard tableaux of shapes /i, u and C/F = 
Tx in the even plactic ring, then V = T^, |Ful97l Section 5.2]. To turn into 
x^r{Tx)^ we proceed in two steps: 

(1) Ascend-sort each of x'^''^^\ x^''^'^''\ and separately. This incurs the sign 

^_I^N<{U)+N{u)+N{x)_ The monomials are now : ^'"'■(^a/.) .. ^wr{T,) . . ~wr{n) 

where the colons denote ascend-sorting. 

(2) To sort these monomials together requires X^j(A/j^)j | j | transpositions. 

The lemma follows. □ 
Theorem 4.8 (Odd Littlewood-Richardson rule). The odd Littlewood-Richardson coefficient 



(4.6) c^, = {-if"^'^. 

S&SSYT{X/^i,v) 
«)r (5) is Yamanouchi 

Proof. The Littlewood-Richardson bijection of ||Ful97l Section 5.2], 

(4.7) {S G SSYT{X/fi, v) : Wr{S) is Yamanouchi} ^ {[/ G SSYT{^l, \/v) : UT^ = Ta}, 

is described as follows. Let Uq be a semistandard Young tableau of shape all of whose 
entries are less than all of those of 5. Then form T5 G SSYT{\) by giving it the entries of C/q 
on ^ C A and the entries of 5 on A/^. Under the RSK correspondence, 

(rA,T5)o(||), 

where x,t have length |^| and u,v_ have length \u\. We can describe what these sub-words 
correspond to under the RSK correspondence as well: 

(?7,C/o)o(|), (T,,r,)o(|) 

for some U G SSYT{fi, \/u). The Littlewood-Richardson bijection 04. 7D assigns U to S. 
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In order to prove the theorem, we have to relate the quantities N^{U) and N^{S). The 
odd RSK correspondence of BEKllll allows us to do this; it implies 

sign(xi;) = (-l)'^^W+^W+^"(^«) 

= (^_l-^dNiX)+NiX)+N< (Uo)+N< (S) 
^^■^^ Sign(x) = (-l)dNM+N<(U)+N<iUo)^ 



sign{v) = (-1 



.dN{u) 



Since we know the contents of x, v, and xv, the sign of the latest can be expressed in terms 
of the former two, 

(4.9) sign(xw) = sign(x)sign(2;)(— l)^*^'*''''^^'!"^!. 

Comparing the signs in equations ( |4.8I > and (|4.9I >, 

^_-^^dN{ti)+dN(u)+dN{X)+N(X)+N<{U)+N<{S)+Y:^{X/u),\!f \ ^ 

Applying this to Lemma l4!7l the theorem follows. □ 

(3 2 1) 

Example 4.9. The first interesting cancellation is C(^2i)(2 i) ~ even case, it equals 2). 

The Littlewood-Richardson skew tableaux of shape (3, 2, 1) / (2, 1) and content (2, 1) are 



They have N^{S) equal to 7 and 6, respectively. 
Remark 4.10. It follows from equation (|2.9|) that 

„A ^ / _-,-sdN{tj,)+dN(u)+dNiX)+N(fj.)+N(u)+N(X) X 

(410) 

These symmetries constrain some signs associated to Young diagrams. For instance, if c^^ ^ 
0,then(-l)^^W+^W = 1. 

4.3. Translation to Knutson-Tao hives. There are many combinatorial expressions for the 
even Littlewood-Richardson coefficients. Among them, the several which are expressible in 
terms of integer points of rational convex polytopes are especially interesting; one reason is 
that as result of Knutson and Tao's proof of the Saturation Conjecture [ KT99 |, Klyachko's 
system of inequalities ]Kly98 1 gives a necessary and sufficient criterion for a Littlewood- 
Richardson coefficient to be nonzero. 

These expressions in terms of polytopes include Gelfand-Zeitlin (GZ) patterns pGZ86l, 
Berenstein-Zelevinsky triangles IIBZ92L the Littlewood-Richardson triangles of Pak and Vallejo 
OPV05L and the honeycombs and hives of Knutson and Tao IIKT99II . As explained in the ex- 
position of IIBucOO|l , the hive model is particularly convenient and flexible. In this section, 
we will write down the bijection of |PV05| from Littlewood-Richardson skew tableaux to 
hives, by way of Littlewood-Richardson triangles. In both the triangle and hive settings, the 
sign associated to a diagram will come from a quadratic form on the ambient space of the 
polytope in question. 
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The following exposition follows IIPV05I rather closely; our only contribution is to track 

the signs which arise in the odd case. For fixed n > I, we will work in = 2 J and 
V = (8)^ R, with coordinates {aij : < i < j < n}. We call elements of V triangles and 
write them pictorially as (for n = 3) 

^0,0 

00,1 

«0,2 CLl,2 02,2 

"0,3 ai,3 «2,3 «3,3- 

Definition 4.11. A Littlewood-Richardson triangle is an element A = (aij) G V such that 

(1) Ojj > for I < i < j < n, 



(2) 



Opj- > flp,i+i for I < i < j < n, and 

p=0 p=0 



(3) 

ai,g > ^ ai+i,g for 1 < i < j < n. 

q=i q=i+l 

Note that aoj < and ajj < are both possible. 

Let Aiji denote the set of all Littlewood-Richardson triangles, a cone in V. Given a 
Littlewood-Richardson triangle A = (aij) S A/,/j, define partitions A, fi, v by 

i k 

p=0 g=i 

Let Alji{X, fi, v) be the set of Littlewood-Richardson triangles with fixed A, /x, v. Each set 
Alr{X, /i, i^) is a convex polytope in V. 

To a Littlewood-Richardson skew tableau S G SSYT{\/ v), associate an element ^4^ of 
ALij(A,/i,i/) by setting 

^0,0 = 0, aoj = fij, 

(4.11) 

Qij = ^{entries equal to i in row j of S} {0 < i < j). 

Lemma 4.12 ([PVOSJ, Lemma 3.1). Suppose |//| + |j/| = |A[. Then the assignment S ^ As is a 
bijection between the set of Littlewood-Richardson tableaux in SSYT{\/ jj., u) and the set of 
integer points of ALji{X, fi, u). 

It is easy to read off N^{S) from the triangle As = {ciij). For each entry aij, write Yij 
for the sum of all the ap^q in the shaded region below, where the place is the dot drawn 
with a hollow center: 
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• o 



More formally, 
(4.12) 

Consider the quadratic form 
(4.13) 



p=0 g=p 



n n I i—1 j—1 

qa(^) = J2 ^i'i^^'^ = J2J2\ ^^'^ J2 J2 ^P'l 

i,j i=0 j=i \ p=0 q=p 

Then it is immediate from the description of the bijection above that 

N<{S) = Qa{As), 

so 

(4.14) c^, = (-1)^('^)+^W Yl (-1)«^(^), 



AGAiH(A,/i,i^)nVa 



as long as A, fi, v all have at most n parts. 
Example 4.13. If 



then 



As = 



10 

and Q/\{As) = 6. 

We now translate this result into the language of hives. 
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Definition 4.14. A hive is an element H = (hij) G V with /io,o = which satisfies the 
inequalities 

{R) hij - > /ij-ij - /ij-ij-i for 1 < i < j < n, 

(4.15) {V) hi-ij - > hij+i - hij for 1 < i < j < n, 

(L) hij - hi-ij > - hij+i for 1 < i < j < n. 

Let S) be the set of all hives; this is a cone in V. The inequalities (|4.15|l have a geometric 
interpretation when we express H as a triangle. Inside a triangle, there are three types of 
rhombi which can be made out of two adjacent smallest-size triangles: 




We call these right-slanted (R), vertical (V), and left-slanted (L) rhombi. The inequalities 
(|4.15|) say that the sum of the entries at the obtuse angles of any such rhombus is greater 
than or equal to the sum at the acute angles; the three inequalities are the right-slanted, 
vertical, and left-slanted cases, respectively. 

As with Littlewood-Richardson triangles, we associate three partitions to a hive, 

LetS){X, ij,,u)he the set of all hives with corresponding partitions A, /i, z^. Each Sj{X, fi,^) is a 
convex polytope in V. 

Theorem 4.15 ( IIPV05I| . Theorem 4.1). Let ^ -.V ^Vhethe linear map which takes A = (a,; ' 
to H = {hij), where 

i 3 

(4.16) ^M = 5ZZ1"P'9- 

p=0 q=p 

Then $ is a volume-preserving isomorphism and induces bijections Alr{X, Sj{X, fi,^) 

for all A, /i, u. 

As a matter of convention, let hij = if either i > j, i < 0, or j > n. It follows from 
equation (|4.16|) and an inclusion-exclusion argument that 

hi,j = tti j + /li-ij + - if < i < i < n, 

(4.17) 

hi^i = ttiA + if < i = j < n. 
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Let Qs) = Qa ° ^ ^- Then for a hive H = (hij), equations !|4.17|) imply 

n n 1 

(4.18) = X] hi-ij-i - f^i-ij - + - ^ 

Note that the parenthesized term is non-negative by the right-slanted rhombus inequality 
{R). It follows that if fi, u, X are partitions with at most n parts, then 

(4.19) N<{S) = QA{As) = Q,,mAs)), 
so 

(4.20) c^, = (_i)^(M)+^(A) ^ 

Hefl(A,At,!^)nyg 

The quantity N{fj,) + A^(A) can also be expressed as a quadratic form in either the variables 
(oij) or the variables (hij). 

Example 4.16. With S and As as in Example 14. 131 



2 3 

(4.21) ^As) = 

3 4 5 
3 5 6 6 

and Qs,mAs)) = 6. 

References 

[BucOO] A. Buch. The saturation conjecture (after A. Rnutson and T. Tao). L'Enseignement Mathematiqiie, lie 

Serie, 46:43-60, 2000. arXiv:math.CO/9810180 
[BZ92] A. Berenstein and A. Zelevinsky. Triple multiplicities for sl{r + 1) and the spectrum of the exterior 

algebra of the adjoint representation. Journal of Algebraic Combinatorics, 1:7-22, 1992. 
[EKll] A. P. Ellis and M. Khovanov. The Hopf algebra of odd symmetric functions. 2011. 

|arXiv:math.QA/ 1107.5610 

[EKLll] A. P. Ellis, M. Khovanov, and A. Lauda. The odd nilHecke algebra and its diagrammatics. 2011. 
arXiv:math.QA/1111.1320 

[Ful97] W. Fulton. Young tableaux: With applications to representation theory and geometry, volume 35 of London 
Mathematical Society Student Texts. Cambridge University Press, Cambridge, 1997. 

[GZ86] I. Celfand and A. Zelevinsky. Multiplicities and good bases for gin. In Group theoretical meth- 
ods in physics, vol. II (Yurmala, 1985), pages 147-159, Utrecht, 1986. VNU Scientific Press, 
http: / / www.math.neu.edu/ zelevinsky /Gelfand-canonical-basis-gln.pdf 

[Kly98] A. Klyachko. Stable bundles, representation theory and Hermitian operators. Selecta Mathematica, New 
Series, 4(3):419-445, 1998. 

[KT99] A. Rnutson and T. Tao. The honeycomb model of GL„{<C) tensor products I: Proof of 

the saturation conjecture. Journal of the American Mathematical Society, 12(4):1055-1090, 1999. 

http://www.ams.org/journals/jams/1999-12-04/S0894-0347-99-00299-4/ 

[ORS07] P Ozsvath, J. Rasmussen, and Z. Szabo. Odd Khovanov homology 2007. ar Xiv:math.Q A/0710.4300l 
[PV05] I. Pak and E. Vallejo. Combinatorics and geometry of Littlewood-Richardson cones. European Journal 

of Combinatorics, 26:995-1008, 2005. http:/ /www.math.ucla.edu/~pak/papers/liri91.pdf 
[Sta99] R. P. Stanley. Enumerative Combinatorics, vol. 2. Cambridge University Press, Cambridge, UK, 1999. 
[WeblOa] B. Webster. Knot invariants and higher representation theory I: Diagrammatic and geometric categori- 

fication of tensor products, 2010. arXiv:math.QA/1 001.2020. 



20 



ALEXANDER P. ELLIS 



[WeblOb] B. Webster. Knot invariants and higher representation theory II: The categorification of quantum knot 
invariants, 2010. |arXiv:math.QA / 1005.4559 

A.P.E.: Department of Mathematics, Columbia University, New York, NY 10027, USA 
email: ellisSmath.columbia.edu 



